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and' affected by the on-site evaluation process for vocational edu- 
cation programs in Illinois. Data, views, -concerns , and improvement- 
oriented recommendations vwere collected from J^am Leaders ,^ Team 
Members, local administrators, teachers, counselors, students and 
community members, as well as DAVTE pGrsor][nel. Responses to a series 
of four major research questions were sought:- 

.1. What procedures have^the DAVTE undertaken in order to 
evaluate programs and services aimed at LEP populations? 



2. What are other sta4:es doing in evaluating services and 
programs aimed at LEP populations? 

3. What are the^views and concerns of the DAVTE staff-, 
local administrators and board members , .i nstructor&^ 
students and community members -with resp^t to the^ 
evaluation of programs) and services aimed at LEP 
populations? \ 

4. What is the extent and nature of the impact on .local- 
education agencies that were evaluated in FY 1980 
#nd care serving LEP students? 

A variety of procedures were use^ to collect *the data utilized 
in the study: ? ^ 

N . 

1, Participant-observation, ' document analysis and inter- ^ 
views were conducted while the principal investigator < ^ 
participated in three on-s'ite evaluations of local 

education agencies providing programs and services to - 
LEP students. 

2. A questionnaire was developed to obtain input from / - 
state ^vopational educ'ation directors, regarding the J 
current 'practices of states in evaluating programs / 

' and services aimed at LEP students. 

'3. Intervt^ws were conducted with 47 individual's to 

discover^and- yerlfy the views and^concerns regarding . * 

the preseat oh-site^val uation system. 'The ijiter- 
views -included: DAVTE 'staff, local administrators, 
instructors, students and community wembers , i,e., 
emploi^ers parents, Advisory Council members, etc. 

4. A questionnaire was developed to obtain input from 
selected LEA personnel, regaigding the'impact on 
programs and services provided to LEP students that- 
w^. evaluated by the TPS in fiscal year 1980. 
Follow-up lihone and personal interviews were con-* 
ducted to acquire a fur^er in-depth perspective 
of the impact. In additio^ document analysis was^ 



conducted ccxnsider the composition of the on- 
^site evaluation team, recommendations made by ^e 
team, changes in the One and Five Year Plan, and 
a^lso the nufpber of LEP students being served by* 
• the LE^, ' . ' 

. 'The discussion, conclusions and recommendations are included 
in the executive summary. 
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EXECUTIVE SUMMARY 



OVERVIEW \ , ■ 

The purpose of the study was to provide a be tter understanding 

of the processes used by the Illinois DAVTE in evaluating voca- 
tional education programs and services aimed at limited English 
proficient (LEP) students in Illinois, This was accomplished by 

( » 4 

developing^and portraying a comprehensive picture of the curcent 
evaluation process. Included in the body of data were the vie\|S 
and concerns of several groups who are involved in and affected by. 
the on-^ite evaluation process for vocational education programs in 
Illinois, Data, views, concerns, and improvement-oriented recom- 
mendations were collected from Team Leaders , Team Members , loctfl 
administrators, teachers, couns.elors, students and community memberai, 
as well as DAVTE personnel. Responses to a seV^ies of four major 
research questions were sought: ^ 



1. What procedures has the DAVTE undertaken in arder to 
evaluate programs and services aimed. at LEP populations? 

2. What are other stcites. doing in evaluating services and 
programs a'lmed at LEP populations? ^ • 

3. What are the views and concerns 'of the"DAVTE staff, 
local administrators and board members, instructors, 
students ^nd community 'nlfembers with respect to the 
evaluation of programs ^nd services aimed at LEP 
populations? 

4; What is tha extent and nature of the impact on local 
education agencies that were. evaluated in FY 1980 
and are serving LEP- students? '^'^ 

A variety of , procedures were used to collect the data utilized 

in the study: . , * 
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1. Participant-observation, document anaiysi-s and 
interviews were coaducted whije the principal 
investigator participated irr three o'n-site evalu^ 
ations of local edueatign agencies providing pro- 
gr^ms^an^ services -to LEP students. 

2. A; questionnaire was developed fo obtain input 
from state vocational education^ di rectors , re- 
garding the current practices of states in* evalu- 
ating programs and services aimed at LEP students. ' 

3. Interviews Were conducted with 47 individuals to 
discover and^ verify the vievfe and concerns regarding 
the present on-si_te evaluation system. The inter- 
v^'ews Included: DAVTE staff, local adimnistrators,. 
instructors, students and commiinity members, iie., 
employers; parents. Advisory Council menibers, etc. 

4. A questionnaire was developed to obtain input from 
' s^elected LE^ personnel, regarding the impact on 

programs and services, provided to LEP students that • ^ i 
v;ere evaluated by the TPS in fiscal year 1980, • ^ 

\F6now-up phone and personal interviews were con- 
\ducted to acquire a ftrrlher in-depth perspective 
of the impac>t. In addition, document analysis was 

. conducted to consider the comppsition of the on- 
site evaluation team, recomjnendations made by th^ • • 
team, changes in the One afid^Five Year Plan, and also 
the number of LEP students-^being served by the LEA. 



DISCUSSION AND SONCLUSIOflS ^ 
Evaluation Procedures of the Illinois DAVTE 

In 1971-72 the 'lll.inois DAVTE developed and implemented a formal 
planning and evaluation system to insure the maintenance, growth; 
and -quality of al_l_ vocational, education programs and se)«*<ices 
Ollinois State Board of Education, 1980)'. In order to fully under- 
stand the- procedures of this Three-Phase System (TPS) several types of 
data were , collected. Data was^ollected through parti cipartt-observation 
ifi three actual on-site evaluations, review of relevant documents and ' ' 



10 



instruments, and^also through interviews with Team Members and 
Le/aders, LEA persDnneV, and staff from the DAVT£. • 

The data indicated that indeed, the^TPS is well received by 
the LCA*s. Personnel at the local education agencies and the 
Team Members perceived the overall on-site^ evaluation as a positive 
and useful activity. These positive feelings toward the overall o/i- 
site evaluation appear, to dissip-ate somewhat with particular refer- 
ence to the usefulness .of the on-site visitation in evaluating pro- 
grams and services aimed at LEP students. 

The procedures and instruments provided by the on-site evaluation 
did not appear to assist either the Team Leader or Members in as- 
sessing the quality of programs serving LEP students. The most 
specific evaluative task under the Student Services Section of the 
Team Mdube'rMia^ focused on the "appropriateness of criteria 
used to identify disadvantaged, handicapped and limited English 
proficiency students and the impact of additional services provided 
to these students/' However, little information or guidance was 
given to Team Leaders or Members in order to determine appropriate 

. identificaton criteria or substantial impact. The process seems 
to rely very heavily upon the knowledge of Team Leaders and Team 
Merpbers in determining the extent^and qcml.ity of programs and ser- 
vices for LEP^tudents. 

,Specific information and guidelines provided by the DAVTE con- 
cerning programs and services for 'LEP students is very limited. 

^Currently, the most substantial piece of information provided by 
the DAVTE to LEAs and to Team Leaders is a handbook 'developed by 
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Lopiez-Valadez (1979) entitled:- Vocational Education for the x 

■ A 

Limited English-Speaking: A Handbook for Administrators , Wh i 1 e 

- 4 

this' handbook provides an' excellent overview and introduction to 

1 , ^ ■ , 

funding resources afid initial programmatic concerns, it does not 
provide inde[yCti^ information regarding theoretical, methodological 
and pK^ogrammatic issues relative to pt^oviding services to LEP 
students. 



Since the efforts of serving LEP students in vocational education 
is new, there is very tittle experience to draw on,' and very liftle 
written on which to base a^conceptual framework (Hurwitz, 1981). 
Most of^the past ^professional experience of the^ DAVTE staff. Team 
Leaders and Members, and 4.EA personnel generally appear to be very 
limited relative to programs and servic-es forlEP students in voca- 
tional educatign. This void in experience in providing services to 
LEP students c^elrly affects the comprehensive' and ;(:)ual ity of pro- 
grams provided, as well as how these programs are evaluated. 

The scope and size of the present TPS may also affect its 
ability to do a thorough evaluation. The TPS was f ield-tested"at ■ 
seven sites during 1970-71. The 1971-72 evaluations included 70 
LEAs, the 1972-73 evailuations expanded to. 116 LEAs, 72 evaluations 
were evaluated during 1974-75, 78 were evaluated during 1976-77, 153 
were evaluated during 1977-78, 150 LEAs, were evaluated in 1978-79, ' 
a'nd.148 LEAs were evaluated iji 1979-80 (Illinois State Board of 
Education, 1980).. According to the 1978-79 Composite Report ; the 
148 LEAs evaluated in FY 1979 included: 129 secondary schools, 
and post-secondary community colleges, and 10 state agencies in' 
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corrections, mental health and rehabilitation services, Teams 
ranged from 1 to^ 33. members in size and involved over 750 total 
Team Members. V_ ^ 

The TPS has provided over the last decade beneficial evaluation 
results. which have assisted in the overall development, planning 
and accountability tasks, of theD'AVTE. However, in view of the 
steady increase of LEAs that are being evaluated each year, and 
also given that three-day on-site evaluation's with sniall teams ^ 
are thie primary method of evaluating LEAsi it is therefore 'doubtful , 
whether the on-site evaluations can product thorough and tompre- 
hensive evaluations. Consideration nlust be given to the fact that, • 
fiscal resources are probably insufficien*t for corrducting "true" 



comprefensive indepth evaluations. 

y ' ^ ^ ' , 

Evaluation Procedures of Other States 

I - ^ ^ 

The questionnaire which was mailed to stcite vocational £ducation 

directors was designed to provide some empirical account of how- * 
many states' have»a separate or specific evaluation projcess for 
evaluating^ vocational education programs serving ,LEP students. 
More specifically, the intent^ of the questionnaire was "to i.denti/} 
the nature and extent of evaluation -practices in other states. 
Data were obtained via 'questionnaire\responses from 41 states and 
four territories. Addi tional .data were'a-lso obtained from state 
education agency (SEA) personnel via follow-up^telephone interviews. 

Results from the questionnaire indicated th'at the vast majority 
of states (91%) did not have a Separate evaluation process for * 
evaluating programs serving LEf students. This'data is consistent 



with a sti'dy undertaken by the National .Institute of Education 
(NIE). The study by i\l£ focused on significant consequences of 
selected changes- in federal vocational education legislation 
adopted in 1976 (Education Amendments' of 1976, P. -L. 94-482). the 
study's interim re'porj by'NIE (1980) in speaking about how states 
were evaluating progriims for special populations stated the fol- 
lowing: , ' • ' ^ , 



Less attervtion -has i been given to the fourth requirement 
laid down by the regulations, evaluating the results of 
additional services to special populations. The pro- 
'gram review process typically examines the attention- 
given to special populations, but focuses on .access , 
not the'results of, vocational programs and Services. _^ • 

(National Institute of Education, 1980, p. V-T2r. 

Data from the questionnaire indicated that 85% the respondents 
fel.t their states were effective in meeting the evaluation require- 
ments set forth by Section 1'12 (Education Amendments of 1976). - Forty- 
six percent (46%) of the respondents indicated that their $tate 
.was effective in evaluating pregrams and services aimed at LEP stu- 
dents. Furt^er 33% of^the respondents felt their state was ef-* 
fectiv^ in uti^lizing evaluatioa results in the improvement of 
programs and serv.iges aimed at LEP s^tudents. Overall these data 
reflected an optimistic and positive vi^w of state efforts in this 
area. However, 37% indicated that their efforts needed to be re- 
vised to meet thB needs ^of LEP 'students. , ^ 

States in general' are evaluating and coljecting data on programs 
and ser-^ices aimed at' LE^ students in a limited fashion, Thfi types 
of data collected address access and criteria for identification. 
The data do not reflecft impact of vocational edu'cation programs. 



Data collected is reflective of the information needs required ^by 

the\ocational Education Data. System (VEDS). The VEDS was a result 

f 

of the 1976 Education Amendments- (Sec. 112). The evali/ation require- 
ments (Sec. 112) intended 'to promote a rational planning and systemalji 
national evaluation process. Information in the VEDS includes: 
instructional expenditures, classification' of students by handi- 
capped, disadvantaged, LEP, racial/ethnic, and sex. In additit)n, • 
student unduplicated headcounts: in occupational programs are also 
reported. The data in the VEDS are aggregated across localities, 
and std'tes to form a national picture (Section, 163(a)(1)). 

Quality of programs and services provided to LEP students is 
rarely accomplished. According to Smith and Holt (1980), the evalu- 
ation procedures for the measurement of student achievement consti- 
tutes the least develol^d conjponent of state vocational education 
evaluation systems. Smith and Holt (1980) state. the following::, 
"Only one-fifth of the states_ had in 1978 pVpcedures for the as- 
sessment of student achievement; those procedures were mostly in 
the .development or pilot-testing state" (P. 34), ^ 

Mainly through the impetus of Piiblic Law 94-482 which identified 
persons of LEP as a ^national priority, states began developing 
programs and, Services to meet the needs of LEP students. However, 
the development and e'valuation requirements specified in the law 
(P,L. 94-482) require/J knowledge and expertise which many state 
personnel' did* not appear |j:o have. ^ 
Critical Views and Concern^ 

Interviews were conducted with a variety of individuals, Persons 
interviewed were members of the State Advisory Council for ^^^tional 

. 7 
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Education, staff of the DAVTE, local administrators, local instructors 

local guidance and counseling personnel, students and community 

•members. THe total number of ii^terviews held with different indi- 

viduals totaled. forty-seven (47). Some persons were interviewed 

twice for the purpose of amplication^ clarification or verification 

of themes and issues. The analysis of the data gained through the, 

interviews was an ongoing process. ^ 

Four themes were identified by the interviewers as being 

\/ 

major issues or concerns relevant to ,the eval uation of. vocational 

programs or services serving LEP students. The interviewer was' 

» hot attempting to generate standardised stimuTi , such as test items 

or questionnaire items. The principal stimult was considered to. 

be those^issues or concerns which were most germane or natural to 

the interviews. The fouc main themes emergtng from the .interviews 

are, as foVlqws: 

A. Strengths a^nd weaknesses of the on-site >Aisita^ion: 

Changes occurring' in the areas' of programs and ser- 
' vices aimed at LEP students as a result of the on- 
site evaluation. 

C. Expertise and composition of on-site Team Members. 

- ^ r ' ^ • ^ 

D. Possible changes of the-on-site evaluation [>rocess' 
with respect to evaluating programs anjd services 
aimed at LPP students. 

The discussion and conclusions drawn from the data collected 

via the interviews will be presented according to the four main 



themes.' 

A. Strengths and weaknes^s of the on-site visitation. 

IG ■ . 



V 

Sfrfirigths of the on-site evaluation which were identified 

are as follow^: the positive effects on team members, the ^ 

positi\/e impact on'LEA*'s, beneficial and timely evaluation 

reports, opportunity by LEA personnel to express opinions, 

and the comprehensiveness of the e>7aluatiVn process. The 

issues related to the weaknesses of the on-site evaluation 

are as follows: the composition of the team members, likeli- 

,hood of fpends evaluating friends, lack of LEA prepa):ation 

prior to on-site visitation, lack of team 'member preparation^ 

prior to qn-site visitation, and the.inabili ty^to evaluate 

the quality* of instruction and programs via the on-site 

process. ^ v 

-The strengths and benefits of the on-site evaluation pro- 
cess arfe generally seen as far out-weighing i^s weaknesses. 
The TPS was perceived .,y local administrators. Team Leaders? 
and ^the staff of the DAVTE as being the ."moving force" which 
assisted vocational education to develop and maintain a high 
level of quality throughout the State of Illipois. Most 
weaknesses of the system wer^e perceived as minor deficiencies ~ » 
of an otherwise excellent system. The impact of the TPS on 
LEAs over the* last ten years was seen as most productive'. 
However, Team Leaders and local admini str*ators which had 
extensive experience with the TPS expressed a concern relative 
to lack of follow-through on recommei^dations^by .the DAVTE. 
This lack of fql low-through on recommendations both by LEAs 
and the DAVTE may very well affect the effectiveness of the 
TPS in the future. - 

9 • © - ' • 
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B. Change^ occurring in the area of programs an'cl services a,imed 
at LEP Istudents as a result of the on-site evaluation. * 
The interview and questionnaire data concerning changes that^ 
had occiirred in LEP programs and services as a result'NDf the 
on-site \\isita'tion did not reflect variability^ The data con- 



sistently y^eflected a paucity of changes, as a result of an 
on-site visitation. ^ The scarcity of changes Which were attri- 
buted to the on-s^te evaluation are most li k^ly explained by 
(1) the lack of emphasis placed on LEP students by the TPS, 
and (2) the lack of awareness concer'ning LEP student needs 
by the on-site evaluation team. This dearth of emphasis 
and awanp^iess on LEP students a^ppears. to signific'antly 
affect the quantity and quality of conclusion's, recommenda- 
tions, and suggested improvements .provided in the final on- 
site evaluation report, ^ 

Vhe content' related to LEP issues and concerns .found in 
final on-site evaluation reports wefe extremely scarce. In 

reviewing final evaluation redorts, conclusions and recom- 
' \ 

mendations generally addressed whether handicapped, di>sad- ^ 

-* 

vantaged or LEP students were receiving'addi tional 'services. 
The qualify or ynpact of these services were rarely addressed. 
Additionally, suggested improvements rarely reflected compre- ^ 



hensive or in-depth improvements toward LEP program^and 
services, * Those changes 6ccurring in LEAs according to 
vinterviews, were th^ results of L^A personnel interests and 



efforts in the ques.t to iDetter serve LEP students, 
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C. E^ertise and composition of on-site team members. 

The interviewand questionnaire data regarding the effects 
' that evaluatt'on team member expertise have on the evaluation 
of programs and services aimed at LEP students W6re varied. 
.The data ranged from the effects being unsubstantial to being 
critical in evaluating these type of programs^ and -services. 
Persons who perceived^the effects on the programs as being 
unsubstantial, also viewed the concept^of teamwork as being 
productive and beneficial. Team Leaders were often times 
viewed as the key to the comprehensiveness of the" on-site ^ 
evaluation. Team Leaders are "generally expected by the DAVTE ' 

♦ 

to be c6gnizant of issues and concerns relative to LEP stu- 
dent pragrams and services-. ^- — 

Selectiop of qualified team members was seen as" essential 
and advantageous for a comprehensive evaluation. LocaUedu- 
cation ^g^'es which were serving. LEP students and were 

^ being evaluated by an on-site team which did not have an 
experienced sf^cial needs team member, were perceived as not 
fully benefiting from a comprehensive on-s,it'e evaluation. 

D. Possible changes of the on-site evaluation process with ^ 

t 

~ respect to evaluating programs an^ services aimed at LEP 

students^ ' \^ k 

The interview and questionnaire data related to possible 
changes of the on-site "evaluation process regardtng LEP 
students were diverse.' Most persons interviewed focused on 
three changes. They were as follows: the composition of 
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the team, the interview tasks in the Team Member Handbook, 
. and the. role of the DAVTE in assisting LEA's implement* 
recommendations found in the final evaluation report. 

The changes suggested in the interviews indicated the 
lack of emphasis by the TPS on LEP issues and concerns and 
also the lack of awareness concerning LEP studen^needs by 
' ^ on-site. evaluation teams. Possible changes which were sug- 
gested, attempt to increase tTie emphasis on LEP student ' 
programs a(nd services by adding interview task to the Team 
^ Member Handbook and alsd by insuring that team members have 
' the necessary experience and knowledge relative to LEP pro-' 
grams and services. Persons interviewed realize the lack 
of expertise and information available regarding LEP stu- 
dents and appeared to place the responsibility with, the DAVTE 
for increasing the emphasis on LEP student programs and services 
and the awareness of LEP 'student needs. This could be ac- 
comp1ishe,d by disseminating the most up-to-date developments 
and strategies on how to serve LEP students via publications, 
in-service ^orkshops, consultant services and through an on- 
site evaluation which could cultivate., sensitize and encourage 
. LEAs to better serve LEP students. 
The' Extent and Naturey(5f the* Impact 

_ 

^ Several data gathering techniques, were used t^^Vl^ect data ire- V 
yarding the extent and nature of *the TPS impact on local education / 
agencies that were evaluated in school year 1979-80. The da.ta were 
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collected through a guestionriai're and formal 'and informal interviews. 

The questionnaire which wa^s maijed to 33 LEA vocational education 

> 

directors was designed to provide some^ quantifiable measures of the 

effect the onrsite visitation had on programs anc/services .provided 

to LEP students. Following the Questionnaire on the Effects of the 

f 

TPS, interviews' were conducted with personnel of three selected 
LEAs, Team Leaders, LEP students, and regional vocational adminis- 
trators. The purpose of the interviews were to acquire a further 
in-depth perspective of the impact of the on-site evaluation upon _ 
programs and services provided to LEP students. . ^ v 

Results from* the questionnaire indicated that over 76% of the 

J ■ . 

respondents rated their overall vocational education program in 

their district a^ being "above" or "well above" average. Data also 

indicated tha^^ m^inimal pe|jj^centage (0.06%) gf LEA administrators, 

vOcatio^n^^structQrs and gui\lance/tounseling pei^onn^l were able 

to comm^fiicate at least minTmally with LEP^students in their native 

language. Furthermore, «the data indicated that 76% Of the LEA 

staff had little or no io-servide training concerning issues and 

concerns of , LEP stu^fntS within the lasCtwo years , 
% 

Data from the*questionnaire regarding the impact of^the on-site 

evaluation were varied. Nearly 62% of the responding administrators 

indicated that the LEAs had gotten some good ideas on how to improve 

programs and ser\tices aimed at LEP stud^ts. However, over 66% of thfe 

respondents^ indicated that the changes that were being made in.pro- 
f ^ * 

grams and services for LEP student were not the direct result of 
information provided by the on-site- evaluation report. Moreover, 57^ 
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.indicateb that the on-si^i^ evaluation process had nojt assisted 
their LEAs in becoming aware of resources or services designed to 
improve programs arwi services aimed- at LEP students. 

TKe data acquired through interviews depicted minimal impact^ 
on programs and seVvices aimed at LEP students by the„ on-s,i te jevalu- 
ation. Changes that were made in the improvement 'of programs ^nd 
services were perceived as a direct result of the efforts ^^f LEA 

* personnel 3nd were not direct results of the on-site*eV,aluat,ion. 



OBSERVATIONS AND RECOMMENDATIONS 

<? 

The DAVTE on-site evaluation process was discovered to be a 
fofrnidable'posi tive factor in the overall maintenance, grovrtft. ^nd 



quality of vocational education ^pro^ rams and services in IlVinois, 
This study revealed, however, that the on-site evaluation process 
was havin^g* a 'min^al positive impact on vocational education pro-^ ^ 
grams and services serving i^p students^ While vocational education 
programs aimecl at LEP populations are a relatively repent educatidnal 
''fx)'rum, very little' is known about the operation* of these programs, 
the instructional practices, and fRe. effects on tr^'nees.in 
'Illinois and other- states, / ' - 

The TPS in accomplishing it's three general goals of developing, 
planning and insuring accountability fqr vocational education,' 
shOTld serve to make persons involved in vocational e^cation more 
av/are dflEP issues and concerns, F^rthermot'e, the*^on-site evalu- 
ation process in evaluating services provided to LEP populations, 
should also s'erve to increase the avyareness and emphasis on LEf 
students within the state and local education agencies. In addition 



to obtaining this ijicreas.ed awareness of and emphasis ort' LEP stu- ^ 

dents, formative program data wouVd assist LEAs in making appropriate 

changes^ and improvements in-programs and services provided to their. 

LEP population. In view of the minimal positive impact the on-site 

evaluation is having on programs and services serving LEP <Students , 

recommendations are provided to* strengthen an al ready -excellent 

TPS, These Vecommendations represent^ a host of views sollected in 

the study; they are global in nature and are not_ presented in a 

prioritized fashion. — - ^ 

The DAVTE should Continue with the on-site evaluation ^ 
with some modification. 



The DAVTE should evaluate the entire TPS to insure quality 
of programs and instruction of all vocational education 
in the State'of Illinois. ^ 

The DAVTE should establish procedures to identify indi- 
viduals who can serve as consul tarvts to the DAVTE and 
LEAs relative to evaluation of LEP programs. and seoiices. 
These individuals could provide several types of services; 
serve as Team Members, provide inservice- training to 
Team Leaders, Team Members , and LEA personnel. Theyi 
could also/assist in identif ic-ation and -development of 
criteria and guidelines for quality programs and 5&r- 
• vices provided to LEP students. 

The, DAVTE should develop and/or identify existing re- 
sources which would assist LEAs in developing and evalu- 
ating programs and services to LEP students, ^ 

The DAVTE should develop cr;iteria and guidelines to - 
/assist Team Leaders and Team Members in evaluating 
/mpogj^ams and services aimed at LEP students, • ^ 

The DAVTE* should increase the utilization of data 
already being collected via the student/employer 
yfollqw-up studies and the VEDS reporting system 
relarhre to LEP students. Utilization may include 
studies and special reports concerning effects of 
vacational education programs and services' on LEP 
•populations, 
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Jhe DAVTE should modify or supplement the Team Member 
Handbook, the School and Communfty Data Form, the stu- 
dent and faculty Preliminary Evaluation Instruments to. 
solicit specific data relative to quality and impact; of- 
programs and services provided to LEP students. 

Th^ DAVTE should increase and strengthen it's follow-up ^ 
activities following on-site evaluations. This activity 
will insure and assist LEAs with the implementation of 
the recommendations made by fhe on-site e\^luation team. 

The DAVTE should study the benefits of incorporating a / 
self-study component into the TPS. 

The DAVTE should clDrrsider utilizing of a separate evaluation . 
process (separate from the TPS) which would provide an 
in-depth perspective on programs and. services serving 
LEP students. Possible evaluation alternatives could be: 

1. Identify a cadre of consultants which are knowledgeable 

in the area of LEP students, and contract these consu-ltants 
to conduct an in-depth evaluation of programs and 
services provided to LEP students 

2. Select LEAs that are serving communities with a sizable 
LEP population and have a consultant from the DAVTE, 
the Regional Vocat^'owal Administrator and an LEP 
consultant conduct an in-d^th evaluation of the programs 
and services provided to LEP students 

3. Once every four years the DAVTE should require LEAs that 
are serving LEP students, to conduct internal in-depth 
evaluations witTi" regards* to the programs and services 
being p rovided to LEP students. LEAs could possibly 
acquire assistance from the cadre of consultants 
identified in alternative 1 ' . 

The DAVTE ^hould sponsor further^tudies on- how to provide 
comprehensive •and quality vocational education programs and 
servic^ to LEP student^. In addition, studies should focus 
on how to determine the'^effects of these programs and services 
on LEP students. 

Local education agencjes should utilize the- Locally Directed 
Evalucftion Material s provided by the DAVTE to evaluate their 
^wn program^ and services aim^d at LEP students. This locally 
directed evaluation process would assist LEA perSQnnel in 
becoming more aware of LEP studertt needs and <;onseq'uently 
change^ or improve the programs d*id services being afforded to 
LEP /students. 

is 



•Local education agencies should develop procedures for 
fdentlfying LEP students in vocational education.. This 
lack of procedures is consistent with the bindings reported 
by Cheaney (1981). 

Local education agencies should be supportive of the efforts 
of vocational instructors, VESL/ESL instructors and the 
guidance/ counsel ing 'staff in serving the needs of LEP students. 

LEA's should utilize whatever resources or services that are 
made available to them by DAVTE concerning nLEP student 
programs and services. . ( ^ - 

Universities should Qff^r off-campus cours^es for local 
personnel on planning ^ar^ evaluating vocational education 
programs and services far LEP students. 



Universi t-tes jshould'encQurage further research on the planning 
and evaluating of vocational education programs and services 
for LEP students. 
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